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AFOSR  Grant  #  F49620-92- J-0176-P00002 
PI  --  William  R.  Uttal 

Studies  of  the  Effect  of  Image  Degradation  and  Recombination 
I:  Summary 

The  second  year  of  this  grant  has  been  very  productive. 

We  completed  the  major  study  that  was  underway  last  year  and 
have  moved  on  to  complete  two  other  major  programmatic 
studies.  The  ongoing  study  that  is  now  complete  was  the  one 
in  which  we  explored  the  effects  of  noise,  Fourier 
filtering,  reduced  acuity  (by  means  of  blocking)  and 
combinations  thereof  in  a  discrimination  task.  Ten 
experiments  were  carried  out  in  this  series.  A  publication 
on  this  work  has  been  submitted  for  publication  and  is  now 
being  reviewed.  From  there  we  went  on  to  consider  the 
combination  of  degradations  by  the  visual  system  rather  than 
by  means  of  the  computer.  In  this  stuay  degraded  images  were 
combined  with  dichoptic  viewing.  A  manuscript  describing 
this  work  has  also  been  submitted  and  is  under  review.  We 
then  undertook  to  study  the  effect  of  combinations  of 
degradations  on  a  recognition  task.  That  work  has  also  been 
completed  and  is  in  the  process  of  being  analyzed.  The  first 
paper  submitted  from  our  laboratory  on  the  psychophysical 
foundations  of  night  vision  devices  has  been  accepted  for 
publication. 

II:  Research  Objectives 

1.  This  project  offers  a  program  of  research  on  the 
psychophysics  of  form.  It  specifically  deals  with  the 
perception  of  degraded  and  incomplete  images.  We  are 
interested  in  the  effect  of  image  degradation  of  the  ability 
of  an  observer  to  detect,  discriminate,  and  recognize 
objects  and  scenes  when  the  quality  of  the  image  has  been 
reduced  by  systematic,  quantified  image  transformations. 

2 .  We  are  also  interested  in  the  complementary  and  closely 
related  problem  of  sensory  fusion  --  how  can  multiple 
aspects  or  dimensions  of  the  degraded  and  incomplete  images 
be  visually  processed  so  that  their  subjective  appearance  is 
of  a  higher  quality  than  it  would  otherwise  be,  and  thus  the 
observer’s  performance  be  enhanced  from  what  it  would 
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otherwise  be.  The  basic  question  in  this  complementary  case 
deals  with  the  ability  of  the  visual  system  to  integrate  or 
combine  low  quality  images  of,  for  example,  differing 
resolution  to  produce  a  high  quality  perception.  It  is  a 
search  for  the  rules  of  visual  spatial  combination  and  for 
the  relative  efficacy  of  what  are  distinguishable  aspects  or 
attributes  of  stimuli. 

3.  The  two  questions  are,  therefore,  two  aspects  of  the 
same  problem.  One  the  one  hand,  what  effect  does  degradation 
have  on  the  percept?  and,  on  the  other,  how  can  the  effects 
of  image  degradation  be  overcome  by  utilizing  the  power  of 
the  visual  system  to  integrate  or  combine  degraded  images? 

4.  We  approach  this  problem  from  two  different  directions. 
First,  we  are  carrying  out  a  program  of  psychophysical 
studies  that  examines  the  effects  of  degradation  and  search 
out  the  nature  of  visual  multidimensional  combination.  The 
long  range  goals  of  the  psychophysical  experiments  are  to 
provide  information  about  the  effects  on  performance  of  the 
human  observer  that  go  beyond  rating  or  ranking  of  the 
subjective  quality  of  an  image.  Second,  we  will  develop 
computer  models  and  measures  of  the  effects  of  image 
degradation  and  of  the  visual  combination  process.  The 
models  so  generated  are  intended  to  provide  the  foundation 
of  a  theoretical  standard  observer  that  can  ultimately  be 
used  to  measure  and  predict  image  "quality." 

Ill  Status  of  Research 

The  second  year  of  our  work  has  continued  to  be 
productive.  First,  we  completed  the  series  of  experiments 
from  the  previous  year  studying  how  combinations  of  image 
degradations  affect  discrimination.  This  work  may  be 
summarized  as  follows: 

This  work  explored  the  ways  in  which 
combinations  of  image  degradations  affect 
discrimination.  Nine  experiments  are  described 
that  examine  the  discriminability  of  visual 
images  that  are  degraded  with  three  types  of 
information  reducing  transformations  --  random 
punctate  visual  interference,  low-pass  spatial 
frequency  filtering,  and  local  area  averaging. 

The  results  of  these  experiments  characterize  a 
powerful  visual  ability  to  discriminate  highly 
degraded  stimuli  unless  severely  challenged  by 
relatively  high  levels  of  random  visual 
interference.  An  important  result  is  a 
demonstration  of  an  apparent  perceptual 
commutativity  of  the  orders  in  which  the  other 
two  degradations  are  imposed.  That  is,  the 
order  in  which  the  degradations  are  applied 
does  not  affect  the  final  discriminative 
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outcome.  This  result  is  in  contrast  to 
predictions  from  relevant  mathematics  and 
direct  examination  of  the  images  produced  by 
both  orders  of  degradation.  The  commutativity 
is  attributed  to  the  particularly  strong  effect 
of  the  low- pass  spatial  frequency  filtering 
degradation  on  the  discrimination  process.  This 
study  also  demonstrates  that  combinations  of 
degradations  in  a  discrimination  task  always 
result  in  a  reduction  in  performance,  never  an 
improvement  as  has  been  reported  for 
recognition.  This  difference  is  attributed  to 
the  fact  that  form  discrimination  is  mediated 
by  local  features  and  high  frequency  spatial 
components,  whereas  recognition  is  mediated  by 
global  features  and  low  frequency  spatial 
components . 


Second,  we  completed  a  study  of  dichoptic  combination 
of  degraded  images.  This  work  may  be  summarized  as  follows: 

Two  experiments  were  carried  out  in  which 
information  from  two  different  kinds  of  degraded 
(low-pass  filtered  and  regionally  averaged  or 
blocked)  visual  stimuli  were  combined.  In  the 
first  experiment,  the  degraded  images  are 
perceptually  combined  by  being  separately 
presented  to  each  eye  in  a  dichoptic  viewing 
situation.  Both  stimuli  are  masked  by  identical 
random  visual  interference.  When  the  two  stimuli 
are  dichoptically  presented  visually  fused, 
performance  in  a  discrimination  task  is  enhanced 
over  control  situations  in  which  only  one  of  the 
two  stimuli  is  presented.  In  the  second 
experiment,  the  two  degraded  stimuli  are 
physically  superimposed  prior  to  binocular 
presentation  with  a  similar  result.  We  conclude 
that  a  true  advantageous  information  pooling  is 
occurring  when  these  two  types  of  degraded  stimuli 
are  combined  either  physically  or  dichoptically. 

The  implications  of  these  findings  for 
understanding  the  function  of  the  visual  system 
are  discussed. 

Third,  we  have  completed  data  collection  on  a  ten 
experiment  study  in  which  we  explored  the  effects  of  these 
same  combinations  of  attributes  in  a  recognition  task.  The 
most  important  development  that  has  emerged  so  far  has  been 
the  confirmation  of  the  Harmon  and  Julesz  phenomenon  (i.  e., 
low  pass  filtering  of  a  blocked  image  enhances 
perception) for  recognition  but  the  rejection  of  it  for 
discrimination.  The  data  is  now  being  analyzed  and  prepared 
for  publication. 
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Finally,  we  are  currently  at  work  studying  face 
recognition  as  another  model  stimulus.  In  all  of  the 
previous  work  small  aircraft  silhouettes  were  used  as 
targets.  The  face  is  a  stimulus  that  offers  somewhat  greater 
complexity  and  opportunities  for  examining  a  more 
realistically  challenging  domain. 
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Uttal  was  appointed  consulting  editor  of  the  new  APA  journal 
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VII  New  Developments 

There  were  no  new  patents.  Discoveries  are  of  the  kind 
described  above.  Application  of  our  work  is  relevant  to 
night  vision  devices  and  image  quality. 

VIII  Supplementary  Information 

Progress  was  very  good  this  year.  Publication  lags  are 
keeping  us  "in  press"  and  "submitted"  longer  than  I  would 
like  but  given  our  cold  start  two  years  ago,  our 
productivity  is  high. 
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